~ experts cannot explain the rules they use because they aren't using any

This, in turn, explains why expert systems are never as good as experts. If one asks an expert for the rules he or she is using, one will, in effect, force the expert to regress to the level of a beginner and state the rules learned in school. Thus, instead of using rules he or she no longer remembers, as the knowledge engineers suppose, the expert is forced to remember rules he or she no longer uses. If one programs these rules into a computer, one can use the speed and accuracy of the computer and its ability to store and access millions of facts to outdo a human beginner using the same rules. But such systems are at best competent.

Peripheral Vision: Expertise in Real World Contexts